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FOREWORD 



The NCDPI Division of Accountability Services /Research, in cooperation with the NCDPI 
Division of Curriculum and Instruction Services, has developed diagnostic achievement tests 
of basic skills for public school students in Grades 3, 6, and 8; survey achievement tests of 
Science and Social Studies for students in Grades 3, 6, and 8; and high-school course 
achievement tests for students taking Algebra I, Algebra II, Biology, Chemistry, English I, 
Geometry, Physics, and U.S. History. Physical Science and Economic, Legal, and Political 
Systems will be added in 1991, and other tests are being planned.^ 

To facilitate the proper technical use of the test scores obtained from the administration of tlie 
tests, the curricular and psychometric characteristics of the tests are described in a series of 
technical manuals. This manual, the sixth in the series, contains a description of the charactt ristics 
of the North Carolina Test of U.S. History. 



"Readers who have an interest in the origins of he test development program are referred to the North CaroUna 
Elementary and Secondary Reform Act of 1984, tho North Carolina Basic Education Program, the North Carohna 
Standard Course of Study, and the Teacher Handbook. 
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Description 



The North Carolina Test of U.S. History (NCT-US History) was developed for use as an 
achievement testfollowingthe completion of theU.S.Historycourseofstudy. Its design serves 
a dual purpose: that of a normative measurement of student achievement and of an objective- 
based measurement of curriculum coverage. 

The measurement of student achievement is attained by administering a basic core of 60 items 
and a civic literacy core of 20 items to all students. The measurement of curriculum is met by 
an additional 40 items that vary across three forms of the test. All three forms of the test, each 
form containing the same 60 core items, the same 20 civic literacy core items, and 40 variable 
items, are administered in each classroom, one form per student. Under this system, a third 
of the students in a classroom will take Form 1 of the test, a third will take Form 2, and a third 
will take Form 3 (see Table 1). 



Table 1 

Organization of the North Carolina Test of U.S. History' 



60 Basic Core Items 



20 Civic Literacy Core Items 



40 Variable Items 40 Variable Items 40 Variable Items 



120 Items 120 Items 120 Items 

Form 1 Form 2 Form 3 



The two normative student scores are based on the 60 basic core it^ms and the 20 civic literacy 
items that all forms have in common. Curriculum assessment is achieved by combining the 
results from all three forms, which provide an assessment based on the 60 basic core items -i- 
20 civic hteracy core items + 3(40 variable items), or 200 items in all. 



Validity 



The development of a U.S. History achievement test has two purposes. The first is to obtain 
scores from which inferences may be drawn concerning the degree of success a particular 
student, classroom, school, or school district has had in mastering the U.S. History curriculum. 
The second is to assess the degree to which the curriculum has been mastered by students in 
the aggregate. To the extent this can be done meaningfully, test scores may be said to be valid. 
Thus, one inference drawn from a test score may be valid, while another may not. 

Theoreticians state that only inferences concerning test scores can be said to have validity. 
Generally, readers understand this, and this report will employ the convenient shorthand of 
speaking about "test validity" rather than "inferences about achievement drawn from scores 
obtained from tests." 

Test validity is a predominant theme in test development, from the time the idea for a test is 
conceived until the final test scores have been analyzed and interpreted. For convenience, the 
various components of test validity will be described as if they v/ere unique, independent 
components rather than interrelated parts. The first component of test validity to be described 
will be curricular validity. 

Curricular validity 

If a test is to be used to measure the degree to which a course of study has been mastered, the 
first step is to define the curriculum. In the case of U.S. History, that was done through a 
cooperative effort, led by the NCDPI Program Services/ Division of Curriculum and Instruction 
Services, involving curriculum specialists, teachers, administrators, university professors, and 
others. The result was a list of 18 goals encompassing 106 objectives. Supported by expert 
opinion and a statewide consensus, these goals and objectives were approved by the State 
Board of Education in 1985 as the basis for instruction in U.S. History. Curricular validity, the 
first step in establishing construct validity, was established by this method. 

In 1989, the General Assembly passed the Civic Literacy Bill, which established that certain 
objectives were to be added to the social studies curriculum. These objectives are to deal with 
the founding documents, including the Declaration of Independence, the United States 
Constitution, and the most important of The FederalistPapers. The passage of this bill resulted 
in the addition of nine objectives to the U.S. History curriculum (see Appendix B). These 
objectives will be addressed beginning with the 1991 forms of the North Carolina Test of U.S. 
History. Also in January 1989, the State Board of Education set policy specifying that the 
influence of religion on American history be explicitly included in the U.S. History curriculum. 
This policy resulted in the addition of one goal and four objectives to the U.S. History 
curriculum ''see Appendix B). 
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Instructional validity 



A basic course of study may not include all of the objectives taught under various circumstances 
in U.S. History. For example, some advanced classes may cover material that would be beyond 
the reach of 95% of all U.S. History students. For this reason and several others, it becomes 
important to knovy^ just what is being taught in the majority of U.S. History courses in the state. 
To determine this, all U.S. History teachers in North Carolina were surveyed in May 1986 
(N = 1,168 teachers). The analysis of results was based on 846 responses, or 72% of all possible 
responses. 

The U.S. History teachers examined the original 106 objectives and noted whether they taught 
each objective every year and was basic to instruction. 88 out of the 1 06 objectives were judged 
as basic by a majority of the teachers. After deliberation by curriculum specialists, however, 
it was determined that the 18 goals and all of the 106 objectives formed the essential curriculum 
for U.S. History and should be tested. The objectives are given in Appendix A together with 
the proportion of teachers judging each one to be basic. 

Instructional validity, the second step in defining construct validity, was established by these 
procedures. It defines the inferences that can be drawn from U.S. History test scores. 

In summary, it was concluded that curricular and instructional validity depended jointly on 
the 18 goals and the 106 objectives under which they were collected, and that the U.S. History 
test should be built on that foundation. 

Content validity 

Content validity — the degree to which test items reflect the basic instructional p rogram — is a 
quality commonly referenced in evaluating achievement tests. Content validity is built into a 
test from the beginning, and the procedures relating to the content validation of the North 
Carolina Test of U.S. History are described below. 

Content validity of the item pool (Phase One). The initial content validity of the item pool 
was defined through a number of operations: 

First, the item pool for the U.S. History test was created in 1986. It was specified that the pool 
would have 1298 items, with 4 to 40 items per objective (generally 4 to 12 items for objectives 
prior to the 20th century and 10 to 20 items for objectives covering the 20th century). The items 
v/ere developed by 1 1 North Carolina U.S. History teachers trained in the technical aspects of 
item-writing. The use of classroom teachers from across the state helped to insure that 
instructional validity was maintained, since the items would be drawn from their classroom 
experiences. A total of 1288 items were actually written for the U.S. History item pool. 

Second, the item pool was edited for grammar, syntax, psychometric form, and linguistic bias. 
145 items were deleted from the U.S. History item pool at this time. 




Technical Manual Page 3 



I . i f ^ was analyzed by curriculum specialists and classroom teachers to assure 
that the Items were valid representations of the objectives for which they were written. Each 
Item was reviewed by at least four classroom teachers from different educational regions 
across the state. The criteria for evaluating each item included the following: 

• curriculum match-objective, difficulty level, thinking skills level, and vocabulary 

• format— familiarity, print size/style, and mechanics 

• art— clarity, accuracy, and labeling 

• item bias— gender, ethnicity, SES/location, or other 

• stem— accuracy, ambiguity, single problem, wordiness, and complete statement 

• answer choices— one best, homogeneity, logical order, and clues/cues. 

155 items were deleted from the U.S. History item pool at this time. 

Fourth, the items were collected into 1 1 test forms for field tesHng. Although the forms were 
not the final forms of the North Carolina Test of U.S. History, they were organized in such a 
way that the objectives were represented equitably across all forms. Each form contained 98 
to 100 Items, 10 of which were common aaoss all forms for the purpose of ability equating 
should that become necessary. / n & 

Fifth, test administration instructions were written, distribution procedures were organized 
and administrators were trained to conduct the test administration. The test administration 
organization used to administer statewide tests in North Carolina was employed to do the field 
testing. The administration of the test forms followed the routine eventually expected to be 
used when the test of record was given. 

Sixth, a sample of 7,474 students was selected to take the 1 1 field test forms containing a total 
of 997 Items. To insure broad representation, schools were !:clected from each of the eight 
North Carolina educational regions. The 1 1 field tests were interleaved in all student samples 
and this produced an even spread of ability across all of the tests. Consequentiy, each item was 
answered by approximately 679 students (the number of students per field test form ranged 
from 663 to 690). ^ 

Seventh, the field test data were analyzed using both the classical psychometric model and the 
one-parameter Rasch model (results were generated from the BICAL computer program). 
Sixteen statistics were assembled for each item, i.e., p-value, Rasch difficulty index, adjusted 
Rasch difficulty index, standard error of the mean, fit mean-square, item validity (pcint- 
biserial correlation) and the item characteristic curve groupings. Item bias due to gender or 
ethnicity was examined by computing the partial correlation between the item score and 
gender/ethnic while controlling for total score. The item statistics were visually scanned and 
Items were "flagged" for possible deletion where the item statistics were not psychometrically 
appropriate for future test development. 

This information was placed on an item record, which became the basic document to which all 
other records were referred. The item record contains the goal, objecti v e, historical information, 
a copy of the item itself, the item field-test statistics, and the psychometric and curricular 
decisions concerning the ite m^s adequacy. Each item has a separate item record. 

O ^ — NCT-US History 
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Of the 997 items field tested in 1987, 282 (28.5%) exhibited a p-value below .30, were classified 
as "too difficult", and were deleted from the item pool. Usually, the items were "too difficult" 
because of defective foils or imprecisely worded stems. This left 715 items (71 .5%) in the U.S. 
History item pool for future test development. 

Content validity of tf^e item pool (Please II). Due to the large number of items that were 
deleted from the item pool in 1987, it became necessary to develop additional items for the item 
pool. The greatest need was for items in the higher range of p's. 

First, the number of items needed per objective was determined Trom the existing item pool. 
The number needed per objective ranged from 1 to 20 for a total of 631 items. 597 new items 
were written by ten North Carolina U.S. History teachers, and 34 previously deleted items 
were revised by curriculum specialists. 

Second, the additional item pool was edited for grammar, syntax, psychometric form, and 
linguistic bias. 22 items were deleted from the additional item pool at this time. 

Third, the item pool was analyzed by curriculum specialists and classroom teachers to assure 
that the items were valid representations of the objectives for which they were written. Each 
item was reviewed by one classroom teacher in each of the eight educational regions of North 
Carolina. The expanded criteria for evaluating each item included the following; 

• conceptual — objective match, fair representation, lack of cultural bias, clear statement, 
single problem, one best answer, common context in foils, each foil credible 

• language — appropriate for age; correct punctuation, spelling, and grammar; lack of 
excess words; no stem/foil clues; no negatives in foils 

• format — logical order of foils; familiar presentation style, print size, and type; correct 
mechanics and appearance; equal length foils 

• diagram — necessary, clean, relevant, unbiased. 

118 items were deleted from the additional item pool at this time. 

Fourth, the items were collected into 13 sets of 40 items each. The sets were used as variable 
items during the 1988 statewide administration, and the field-test forms were interleaved with 
the statewide forms to insure an even spread of ability levels. The field test forms of the 1988 
North Carolina Test of U.S. History were administered to 16,587 students. Consequently, each 
new item was answered by approximately 1 ,276 students (the number of students per field test 
form ranged from 925 to 1,604). 

Fifth, the field test data were analyzed using procedures similar to those described above. 
Eighteen statistics were assembled for each item (estimates of gender and ethnic bias were also 
obtained at this time). 

The item statistics were submitted to compucer analysis using a program designed to scan the 
statistics for an item and print out an appropriate decision based on the criteria that had been 
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built into the program specifically for U.S. History. An item was classified as "too hard" i; the 
p-value was less than .30. An item was said to have "weak prediction" if the point-biserial 
correlation was less than .18. An item was said to have an "entrapment choice", a "marginal 
top group", or an "inverted ICC" if the item characteristic curve groupings displayed certain 
irregularities. A item was said to exhibit "gender" bias if the partial correlation with gender 
was more extreme than ± .13, and to exhibit "ethnic" bias if the partial correlation with ethnic 
was more extrem.e than ± .12. 

TliecontentofU.S.Historycannotberepresentedbyasinglefactor. Therefore, themaximization 
ot Item-total (pomt-biserial) correlations was not agoalof item development. Once an item was 
shown to have at least a modest correlation with a corrected total score (.18 or greater) and was 
judged to measure an objective, it was included in the item pool. While this may have reduced 
the potential internal reliability as measured by coefficient alpha, it increased the validity of th^ 
test by allowing for an objective factor structure that was not expected to be unitary. 

This information was then placed on the item record, which became the basic document to 
which all other records are referred. The psychometi-ic notations were reviewed and decisions 
were made about ihe adequacy of the items. The decisions were then conveyed to curriculum 
specialists, who also reviewed the items and reached a decision about their curricular 
adequacy. 

Ofthe491itemsfield-testedin 1988,61 (12.4%)weredeletedfromtheadditionalitempool The 
remaining 430 were merged with the original item pool for a total of 1143 items available for 
test development. 

Content validity of the item pool (Phase III). Due to the passage of the Civic Literacy Bill 
m 1989 by the North Carolina General Assembly, nine objectives were added to the U.S. 
History curriculum and, consequentiy, items were needed for future test development. 

First, 12 to 26 items were created for each of the nine civic literacy objectives for a total of 162 
Items. Where the existing item pool was insufficient, 28 items were written for existing 
objectives and 22 existing items were revised. 

Second, the additional item pool was edited for grammar, syntax, psychometric form, and 
linguistic bias. Eight items were deleted from the item pool at this time. 

Third, the additional item pool was analyzed by curriculum specialists and classroom teachers 
to insure that the items were valid representations of the objectives for which they were wri tten 
using the procedures previously described in Phase II of the item pool development. Seven 
Items were deleted from the additional item pool at this time. 

Fourth, the items were collected into 6 sets of 20 items each. Due to the limited number of items 
that could be field-tested at this time, 73 items were held for field testing at a later time. Two 
sets were added to each of the three existing 1990 test forms, creating six 120-item tests. The 
data from these field tests will be analyzed in 1990 and used in constructing the 1991 NCT-US 
History. 
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Content validity of the test. After a consideration of the logistics involved, it was decided 
to prepare one complete test (60 core items and three sets of 40 variable items) for administration 
in May 1988, and to develop two additional core tests of 60 items each for use in succeeding 
years. Core tests were based on a random selection of the objectives within each part of the U.S. 
History curriculum (pre-20th century and 20th century), for a total of 60 items (30 items 
covering pre-20th century and 30 items covering the 20th century) randomly chosen from the 
approved item pool. Thus, the content of the test cores directly reflected all of the decisions that 
had been made earlier. 

This method of item selection is a modified domain sampling model, with the various forms 
and cores randomly equivalent. The domain sampling model in its pure form is highly 
inefficient because it allows the entry of items that are grossly inappropriate for normative 
measurement — items that no one can answer or that everyone can answer, or that have 
psychometric deficiencies of a more complex form. In the modification used here, t \ j domain 
of items was limited to those items that had satisfactory psychometric characteristics. This was 
determined by the analyses of the i tem field-test data, which was used to verify the psychometric 
adequacy of the item pool and to direct where item revisions should be made. 

After the test was assembled into forms (60-item core plus a 40-item variable set), the forms 
were reviewed by one curriculum supervisor and two teachers in each of the eight educational 
regions. The criteria for evaluating each form of the test included the following: 

• that the content of the test should reflect the goals and objectives taught 

• that the items should be clearly and concisely written, and the vocabulary is appropriate 
to the target age level 

• that the content should be balanced in relation to ethnicity, sex, socioeconomic status, 
and geographic district of the state 

• that each item should have one and only one answer that is best; however, the 
distracters appear plausible for someone who has not achieved mastery of the 
represented objective 

The ratings for the 1988, 1989, and 1990 North Carolina Test of U.S. History were average to 
superior on all of the criteria. 

Although the initial equating of the core tests depended upon random selection of items from 
the item pool, the final equating was bajed on the statistics obtained at the time the first test 
of record was administered (see Table 2). This second psychometric analysis, described next, 
was used to eliminate random differences among the cores and thus facilitate the precision of 
measurement from one year to another. 

Standardization sample. The first North Carolina Test of U.S. History consisted of three 
forms (A-C), each form containing the same 60 core items and a unique set of 40 variable items. 
This test was administered to 72,824 North Carolina U.S. History students in May 1988. The 
state norm population compriseF these 72,824 students. 
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The two additional cores that were developed were used as variable items for this first test of 
record. Each of the 120 items was answered by approximately 24,300 students and was 
randomly distributed across the three variable sets. The agreement of the mean core scores 
(sum across all item p-values on the core) supported the view that the initial equating process 
described above was successful (see Table 2). 



Table 2 

Core Development of the North Carolina Test of U.S. History 


Core 


Process 


Mean of 
P-values for 
All Items 


SD Of 
P-values for 
All Items 


Sum of 
P-voiues for 
All Items 


1 


Design' 


0.622 


0.115 


37.30 




Administer'' 


0.666 


0.120 


39.98 


2 


Design* 


0.619 


0.112 


37.54 




Administer'' 


0.665 


0.110 


39.89 




Equate' 


0.665 


0.117 


39.98 


3 


Design* 


0.619 


0.110 


37.16 




Administer'' 


0.651 


0.119 


39.03 




Equate*^ 


0.666 


0.122 


39.95 



* Based on 1987 Field Test item p- values. 

''Administered statewide in May 1988: Core 1— core items; Cores 2 and 3 — variable items. 
" Equated to Core 1 by matching the distributions of item p-values obtained during the 1988 statewide 
administration. 



Concurrent validity of the test 

When the 1988 and 1989 North Carolina Tests of U.S. History were administered, U.S. History 
teachers were asked to indicate the expected final letter grade for each student in their classes. 
Figures 1 and 2 display a comparison of letter grades and the mean U.S. History core score 
corresponding to each letter grade for the overall student populations. The figures are 
consistent and add to the evidence concerning the equivalence of the core tests. 
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Figure 1. Comparison of letter grades teachers expected students to 
receive and scores subsequently earned on the 60-item 1983 
N^m Carolina Test of U.S. History (N = 70^08 students). 
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Figure 2. Comparison of letter grades teachers expected students to 
^ receive and scores subsequently earned on the 60-item 1989 
North Carolina Test of U.S. History (N = 65,767 students). 
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Method for Deriving Test Scores 



Item information was available to support the classical scoring model and the Rasch scoring 
model. The classical scoring model gives a unitary weight to each item; a correct choice adds 
1 to the total score, an incorrect choices adds 0. The one-parameter Rasch model also uses 
unitary weighting. (The two- and three-parameter item response models give more credit for 
answering some items correctly and less credit for answering other items correctly. These 
models assume that each item has a fundamental, unchanging difficulty level.) 

The classical scoring model was utilized to score the North Carolina Test of U.S. History 
because it is fundamentally sound, simple to use, and easy to interpret. Each studenf s basic 
total core score consists of the sum of right answers to the 60 basic core items. Each student's 
civic literacy core score consists of the sum of the right answers to the 20 civic literacy core items 
(beginning in 1991). 
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Reliability and Other Statistics 



The descriptive statistics, the standard errors of measurement, the alpha reliability coefficients, 
and the alternate form reliability estimates (correlation between the second statewide core test 
and the other two cores field-tested in 1989) for the first statewide administration of the North 
Carolina Test of U.S. History in May 1988 (Core 1 /Forms A-C), the second statewide 
administration in May 1989 (Core 2/Forms E-G), and the cores field- tested in May 1989 (Cores 
1 and 3) are given in Table 3. 



Table 3 

Descriptive Statistics of the North Carolina Tests of US History 



Reliability 

Core N Mean SD Median se^. Alternate Coefficient 

Form Alpha 



1/A-C 


72,824 


39.9 


10.09 


41 


3.32 




.89 (A-C) 


1" 


711 


39.02 


9.85 


40 


3.41 


.81 


.88 


2* 




39.98 


7.02 










2a,b (1) 


711 


41.58 


9.26 


43 


3.21 


.81 


.88 


(3) 


719 


41.89 


9.43 


44 


3.13 


.79 


.89 


2VE-G 


66,862 


42.0 


9.63 


44 








3*' 


719 


38.97 


10.45 


41 


3.30 


.79 


.90 


3* 




39.95 


7.32 











"Equated to Core 1 by matching the distributions of p- values from the statewide administrations of Cores 1, 
2, and 3 in May 1988. 

''Based on matched samples of students taking the statewide core (2) and one of the field cores 
(1 or 3). The sample sizes are as follows: Core 1, N = 749; and Core 3, N = 736. 



The 1988 basic core scores are distributed about a median of 41, or 68% correct (see Figure 3) 
and the 1989 basic core scores are distributed about a median of 44, or 73% correct (see Figure 
4). The alpha reliability estimates have a mean value of .89; and the alternate form reliability 
estimates have a mean value of .80. 
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Figure 3. Frequency distribution of scores on the 60-item 1988 North 
Carolina Test of U.S. History— Core 1 /Forms A-C 
(N = 72,824 students). 
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Figure 4. Frequency distribution of scores on the 60-item m9 M 
^ Carolina Test of U.S. History-Core 2/Forms E-G 



(N = 66,862 students). 
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For practical purposes, the proper measure of reliability is the alternate form reliability. The 
calculation of this statistic requires that two or more equivalent test forms be developed. The 
older alternate form reliability procedure required the development Df one form, which was 
then "cloned" to obtain a second, alternate form of the test. A judicious selection of alternate 
items was recommended to prevent direct memory transfer from the administration of one test 
to its alternate form. But the possibility remained that errors oi selection in the first form would 
be duplicated in the second form. A newer procedure requires that the tests be truly 
equivalent — that is, that two or more tests be developed in exactly the same way, but 
independently of one another. This permits the reliability coefficient to reflect any random 
errors of selection made in the development of either of the test forms. 

The alternate forms developed for the North Carolina Test of U.S. History reflect this newer 
procedure. That is, each test form is developed from the domain of items in exactly the same 
manner. Any failure of the alternate form reliability to be 1.00 reflects: 

• trait instability not following from maturation or instruction 

• instrument instability resulting from fallible test development procedures 

• administrative instability reflecting different testing occasions. 

The square of the alternate form reliability coefficient accurately reflects the maximum 
proportion of variance one can legitimately expect to predict from the administration of the 
North Carolina Test of U.S. History (r^ = .80^ = .64) when test scores are compared across time 
or with other measures of student abilities or personality traits that have similar reliabilities. 
In brief, the alternate form reliability correlation coefficient is the statistic to use when 
correcting for attenuation. 

Of special significance to the comparison of students scores across time is the equivalence of 
the two future core tests (Cores 2 and 3) to the first core test of record (Core 1 administered May 
1988). Due to the fact that no one student was administered two entire cores, the distribution 
of the p-values of the Core 1 items was compared to the distributions of the p-values of the Core 
2 and Core 3 items to examine the equivalence of Cores 2 and 3 to Core 1 . Figures 5 and 7 show 
the results of the p-value distribution comparisons. 

In Figures 5 and 7, the differences between the curves (p-value distributions) are small. These 
differences could be adjusted statistically by providing a separate set of norms for each core. 
A simple and efficient alternative is to redevelop the cores slightly so that even small 
differences disappear. With this technique, a single norms table can be used for all cores. To 
accomplish this transformation, the test developer had available the 60 items on the core test 
of record (Core 1) for which comparable psychometric data was available for items on Cores 
2 and 3. 

The results of the adjustments for Core 2 and Core 3, employed in 1989 and 1990, are given in 
Table 2 and Figures 6 and 8. The required changes were minimal (2 items on Core 2 and 5 items 
on Core 3). 
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Rank of Item P- value 
□ Core 1 + Core 2 

Figure 5. Item p- value distributions of the 1988 North Carolina Test of 
U.S. History Core 1 and the 1988 Field Test Core 2 
(unadjusted). 
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Figure 6. Item p-value distributions of the 1988 North Carolina Test of 
U.S. History Core 1 and the 1988 Field Test Core 2 (equated). 
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Figure 7. Item p-value distributions of the 1988 North Carolina Test of 
U.S. History Core 1 and the 1988 Field Test Core 3 
(unadjusted). 
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Rank of Item P-value 
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Figure 8. Item p-value distributions of the 1988 North CaroUna Test of 
U.S. History Ccrs 1 and the 1988 Field Test Core 3 (equated). 




Technical Manual Page 19 

26 



To examine the success of the equating technique described above, an equipercentile comparison 
of Core 1 with Core 2 was conducted using the results from the 1988 Core 1 administration and 
the 1989 Core 2 administration. The scores from a random sample of 2,179 students that took 
the 1988 NCT-US History and a random sample of 2,034 students that took the 1989 NCT-US 
History wc selected. To make this comparison, the mean of a block of scores on Core 1 within 
successive five percentile points was taken to compare with the mean of a block of scores on 
Core 2 within the same five percentile points. This yielded twenty reasonably reliable points 
of comparison which are displayed graphically in Figure 9. The distributions of both sets of 
scores are similar, with Core 2 higher. These results are consistent with previous research on 
other achievement tests (Algebra I, Algebra II, and Biology) where the scores from the second 
year of administration increase. 
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Figure 9. Equipercentile comparison of the 1988 North Carolina Test 
of U.S. History— Core 1 /Forms A-C and the 1989 North 
Carolina Test of U.S. History— Core 2(equated) /Forms E-G. 
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While the procedure of matched p-value distributions was satisfactory to equate Core 1 with 
Core 2, it is not recommended as: a replacement for the equipercentile procedure. Generally, 
consistent linear relationships between test forms are obtained when the equipercentile 
procedure is employed. For the NCT-US History, the distribution of Core 2 semidecile scores 
was not exactly linear compared with the Core 1 semidecile scores. 

The adjustments to the core tests assure the continuity of the norms table for future years while 
providing new test items each year. The new test items prevent the loss of confidentiality, and 
therefore validity, that occurs with the continued use of the same items. Student scores have 
a common reference point from 1988 onward, barring changes in the definition of the basic 
instructional program. 
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Curricular Assessment 



Thus far in this manual the 60-item core test has been discussed as if it made up the entire test. 
In actuality, the 1988, 1989, and 1990 North Carolina Test of U.S. History consisted of a 60-item 
core and 40 additional items that varied across the three forms. (See Table 1. The civic literacy 
core will be a part of the test beginning in 1991.) The variable items were not intended to 
contribute to individual student scores, but rather to curriculum assessment. Each variable 
item was answered by one-third of the students. 

At the classroom level, 180 [200 beginning in 1991] items are answered during each test 
administration by an average of three students. This procedure provides a database of one to 
three items per objective across three students. From this database of information, estimates 
of how various portions of the curriculum are being mastered in the classroom may be drawn. 
At the school, school district, and state level, the 180 items are answered by a much larger 
number of students: up to 24,300 students per item. This assures a more stable measurement, 
but does not include a larger number of objectives or items. The accumulation of item and 
objective information depends upon measurement across successive years. 

The measurement afforded by the 1 20 variable items is critical to assessing curriculum mastery 
at the classroom, school, school district, and state levels. Each year of test administration adds 
to the database? and gives a more detailed and comprehensive picture of curriculum success. 
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Content of The Test 



The North Carolina Test of U.S History is objective-referenced; that is, its reference is to a 
domain of objectives. This domain is mapped over a domain of items, where the items reflect 
the objectives, equal in kind and number except for random fluctuations. The U.S. History tests 
v^ere designed to achieve an even assessment across all objectives within time-period 
specifications; in short, each objective was to be represented by the same number of items. Thij^ 
design is consistent v/ith. the concept of a domain of objectives mapped over by a domain of 
items. Although the objective? have unit weighting, the goals are weighted by the number of 
objectives assigned to them. From empirical analyses, this is a traditional aspect of curriculum 
development: the more important a goal is considered to be, the greater the number of 
objectives that v^ll be developed for it. Thus, an underlying system of weights exists for the 
curricular goals. 

Appendix A lists each goal and objective and the numerical item representation for each 
objective as it appears on the 1988, 1989, and 1990 North Carolina Test of U.S. History (Forms 
A-J). In addition, the proportion of teachers rating each objective as basic to instruction in the 
U.S. History curriculum is listed. 

Tables 4 through 6 list the difficulty ieve' for all items on the 1988, 1989, and 1990 North 
Carolina Test of U.S. History (Forms A-J) in terms of p-values (proportion of all students 
answering the item correctly). 
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Table 4-1 

Item Difficulty by Item Number for the 1988 NCT-US History-Core 1 


ii^m w 


r"VaiU6 


iTem w 


r-vaiue 


Item # 


P-value 


1 


.51 


21 


.54 


41 


.66 


2 


.48 


22 


.57 


42 


.81 


3 


.68 


23 


.67 


43 


.56 


4 


.70 


24 


.67 


44 


.37 


5 


.90 


25 


.62 


45 


.50 


6 


.64 


26 


.75 


46 


.53 


7 


.64 


27 


.78 


47 


.44 


8 


.76 


28 


.56 


48 


.60 


9 


.78 


29 


.59 


49 


.61 


10 


.58 


30 


.49 


50 


.47 


11 


.70 


31 


.61 


51 


.59 


12 


.69 


32 


.7? 


52 


.55 


13 


.62 


33 


.53 


53 


.38 


14 


.71 


34 


.43 


54 


.52 


15 


.71 


35 


.62 


55 


.60 


16 


.64 


36 


.60 


56 


.49 


17 


.54 


37 


.75 


57 


.74 


18 


.91 


38 


.61 


58 


.48 


19 


.60 


39 


.64 


59 


.71 


20 


.65 


40 


.82 


60 


.68 
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Item Difficulty by Item Number for the 1988 NCT-US History- 


-Variables A, B, & C 


Item # 


P-vclue 


ltem# 


P-volue 


ltem# 


P-volue 


A 1 


.4/ 


Dl 


.DO 


L-1 


AQ 
.07 


AO 


.54 


dZ 


.0/ 


r^o 

L-Z 


•oD 


A'X 
Ao 


QA 

.84 


DO 


.OD 


^D 


A1 
.01 


A A 


.3/ 


d4 




C^A 
V^4 


A1 
•Ol 


A 


HA 
.04 


dD 


.Dl 


V^D 


A1 
•01 


A A 
AO 


.oZ 


do 


.Do 


r^A 
v^o 


.Do 


A7 
A/ 


Aft 


d/ 


.01 


^•7 


A1 
.01 


Aft 
Ao 


HO 


DO 


QO 

.oZ 


f^ft 
V^O 


An 


AQ 
A^ 


•D/ 


D^ 


.DU 




AQ 


Ain 


7ft 


D 1 U 


.OD 


Pin 

lU 


E^Q 


A1 1 
/All 


.01 


D 1 1 


7e; 
./D 


P11 


7E^ 


A19 




R1 9 
D 1 Z 


.DD 


P19 
IZ 


AA 


A1 


.DO 


DiO 


.40 


r^i 


Aft 
.00 




.Dl 


R1 A 
Dl*t 


E^7 
.D/ 




7e; 

./D 


A1 
Al3 


J L 


DID 


77 


e; 

v^lD 


AR 
.4D 


AlO 


7n 
./u 


DlO 


yl E^ 
.4D 


r^i A 

v^lO 


E^ft 
•Do 


A17 




R1 7 
Dl / 


.Do 


r^i7 
1 / 


A'^ 


Alft 


E^ft 

.Do 


D lo 


E^O 

.DZ 


Pi ft 
lo 


.DZ 


A1Q 


Aft 
.OO 


R1Q 


7e; 
./D 


PIQ 


A1 
•Ol 


A9n 


E^7 

.D/ 


R9n 

DZU 


AO 
.OZ 


P9n 


77 


A91 




R91 

DZ. 1 


79 
./ Z 


P91 


7Q 


A99 




R99 


AQ 
.0^ 


P99 

\^HH 


ftQ 


A9'^ 


E^7 


R9'^ 


'^ft 
•DO 


v^zo 


R9 


A 94. 


ftD 


R9A 


Ae; 
.OD 


P9A 


R7 


A9S 


A9 
•OZ 


R9E^ 
DZD 


ae; 

.OD 


P9e; 


A7 
.0/ 


A9A 




R9A 
DZO 


ae; 

.OD 


r'9A 


e;a 

.DO 


A97 


.00 


R97 
DZ/ 


A*^ 
.00 


P97 


ft7 
.0/ 


A9R 


71 


R9ft 

DZO 


A1 
.01 


P9ft 
Vw-ZO 


E^Q 
.D" 


A9Q 


.00 


R9Q 
DZ^ 


77 


^90 


Aft 
.00 




E^7 

.D/ 


uO\J 


AW 
.00 




A*^ 
.OD 




.DO 


DOi 


E^A 
.DO 


v^ol 


7n 




J\j 


DOZ 


./o 


P'^O 
L-oZ 


.DD 




./D 




.DO 




C7 

,D/ 


A34 


.57 


B34 


.46 


C34 


.49 


A35 


.44 


B35 


.52 


C35 


.65 


A36 


.49 


B36 


.75 


C36 


.50 


A37 


.58 


B37 


.50 


C37 


.60 


A38 


.55 


B38 


.79 


C38 


.59 


A39 


.42 


B39 


.66 


C39 


.65 


A40 


.52 


B40 


.51 


C40 


.54 
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Item Difficulty by Item Number for the 1989 NCT-US History- 


-Core 2 




iTem w 


r-vaiue 


ITem w 


r-VulU© 


Item # 


P-vclue 


1 


.47 


21 


.56 


41 


.70 


2 


.58 


22 


.78 


42 


.55 


3 


.85 


23 


.82 


43 


.44 


4 


.79 


24 


.40 


44 


.46 


5 


.72 


25 


.61 


45 


.58 


6 


.89 


26 


.65 


46 


.58 


7 


.57 


27 


.75 


47 


.52 


8 


.73 


28 


.70 


48 


.65 


9 


.61 


29 


.75 


49 


.43 


10 


.64 


30 


.63 


50 


.50 


11 


.69 


31 


.59 


51 


.49 


12 


.38 


32 


.68 


52 


.53 


13 


.62 


33 


.64 


53 


.58 


14 


.57 


34 


.46 


54 


.55 


15 


.65 


35 


.56 


55 


.59 


16 


.61 


36 


.75 


56 


.54 


17 


.80 


37 


.77 


57 


.66 


18 


.75 


38 


.70 


58 


.57 


19 


.66 


39 


.76 


59 


.67 


20 


.63 


40 


.57 


60 


.61 
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Item Difficulty by Item Number for the 1989 NCT-US History- 


-Variables E,F,&G 


Item # 


P-value 


ltem# 


P-vclue 


Item # 


P-value 


F1 


M 

•oy 


F1 


Q1 




Rfl 
•OU 






V7 


A9 


CD 


A7 


no 




V\ 
ro 


.ou 


oO 


A7 




An 




.ou 


CA 


Af; 
.40 


tlD 


./U 


rO 


.41 


C^ 
oO 


CA 
.04 






ro 


.4o 


r^A 

VjO 


•Do 


E./ 


CI 


r/ 


♦4o 


1^7 


ftn 

.oU 


IlO 




ro 


7R 

Jo 


VjO 


.OU 






r^ 


.4o 




A7 
.4/ 


Fin 




F1 n 

r 1 u 


7ft 
./O 


ni n 

vjIU 


A7 
.0/ 


F1 1 




F1 1 
r 1 1 


.OO 


CA 1 
vjI 1 


.OO 


F19 

12* 1 ^ 


^A 


F19 


C^l 
.Ol 


ni9 


*ou 


FT^ 

12* 1 (J 


Q1 




'^ft 
.OO 


ni 


R4 

.04 


Fid. 

12* 1 ^ 




F1 A 


Rft 
.OO 


niA 


»oy 


FIR 

12* 1^ 


• D/ 


F1 R 
r u 


Aft 

.OO 


r;i R 

O 1 o 


R9 
.oz 


Fifi 

12* lO 


•Dy 


F1 A 
no 


R^ 
.OO 


ni A 

Vj lO 


An 
.ou 


F17 

12* 1 / 


• DO 


F17 
r 1 / 


7ft 
./o 


r;i7 


7'i 
•/o 


FIR 

12* 1 0 




FIR 
no 


Ci7 
.0/ 


niR 

VJ lO 


.OO 


F19 

12* 1 7 




F1Q 
V ly 


Rfl 
.ou 


niQ 


Q1 


F9n 

12*^U 


AQ 
•*±y 


F9n 

r 


.ou 


n9n 


CJ, 
.04 


F21 

U*^ 1 


• O 1 


F91 


71 


r;9i 


R9 
.oz 


F22 




F99 


7"\ 


r;99 


7R 
./o 


Fl'^ 
i^^(^ 


• DO 


F9'^ 


A'\ 
.**o 




7n 

./u 


12* 


A9 


F9J. 

rZi*r 


A7 
.0/ 


CIA 

vJZ*r 


7A 
./o 


F9R 

12*^^ 


R1 


F9(^ 


.0^ 


n9C> 

VjZO 


.OO 


F9A 

12* 


A(\ 


F9A 
r^o 


.OO 


n9A 


AQ 

•oy 


F97 

12*^/ 




F97 
rz./ 


7A 
./ft 


n97 


.00 


F9R 

12* 


.ou 


F9R 
rzo 


AA 


n9ft 


.00 


F9Q 

12*Z.Z7 




F9Q 


AA 




79 
./z 


F'^n 

CiOyj 




F'^n 
r»ju 


c>A 
.OO 


\jOU 


79 
i/ z 


F'^l 


R9 


F'^l 


R^ 

.OO 




i7U 


F'^9 

12* 




F'^9 


7ft 
./O 


VjOZ 


.04 


12* (^(^ 


RR 


voo 


AQ 


vjOO 


A9 
.oz 


E34 


.80 


F34 


.87 


G34 


.58 


E35 


.77 


F35 


.45 


G35 


.85 


E36 


.65 


F36 


.66 


G36 


.48 


E37 


.81 


F37 


.36 


G37 


» .73 


E38 


.60 


F38 


.56 


G38 


.53 


E39 


.75 


F39 


.59 


G39 


.42 


E40 


.39 


F40 


.54 


G40 


.44 
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Item Difficulty by Item Number for the 1990 NCT-US Hlstory- 


-Core 3 








iTem w 


r-vaiue 


Item # 


P-value 


1 


.64 


21 


.67 


41 


.81 


2 


.67 


22 


.57 


42 


.56 


3 


.69 


23 


.87 


43 


.57 


4 


.84 


24 


.50 


44 


.57 


5 


.61 


25 


.71 


45 


.45 


6 


.65 


26 


.61 


46 


.55 


7 


.65 


27 


.69 


47 


.52 


8 


.76 


28 


.56 


48 


.49 


9 


.61 


29 


.77 


49 


.75 


10 


.78 


30 


.59 


50 


.50 


11 


.51 


31 


.57 


51 


.60 


12 


.57 


32 


.55 


52 


.32 


13 


.82 


33 


.68 


53 


.42 


14 


.62 


34 


.56 


54 


.79 


15 


.56 


35 


.51 


55 


.52 


16 


.80 


36 


.63 


56 


.65 


17 


.65 


37 


.75 


57 


.51 


18 


.53 


38 


.72 


58 


.68 


19 


.91 


39 


.68 


59 


.77 


20 


.69 


40 


.75 


60 


.63 
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Table 6-2 

Item Difficulty by Item Number for the 1990 NCT-US History- Variables H, 1, & J 


ltem# 


P-value 


ltem# 


P-value 


ltem# 


P-value 


rll 




11 


.51 


T1 


CO 

.53 


rlZ 






OQ 

.3y 


TO 


>!7 
.4/ 




CI 

.Ol 


TO 


C^ 

.56 


J3 


77 

.// 


H4 


.54 


T>l 

14 


.So 


T>1 


C7 

.57 




.o2 


TC 

15 


.66 


TC 


A C\ 

.40 


Ho 


.66 


T^ 

16 


.70 


T^ 

Jo 


OO 

.82 


rl/ 


CO 


T7 
1/ 


C1 

.51 


T7 

J7 


AC 

.46 


T TQ 

Ho 


.ol 


TO 

18 


.68 


TO 

Jo 


CQ 

.59 


Hy 


.00 


TQ 
ly 


.65 


TQ 

J^ 


C2l 

.56 


1-11 n 
rllU 


Ad 


T1 n 
IIU 


on 
.oO 


T1 n 
JIU 


C1 

.51 


rll 1 


.46 


T1 1 
111 


CO 

.53 


T1 1 
J A A 


.Zo 




.4y 


T1 0 

HZ 


A 1 

.41 


T1 O 


C7 

.5/ 


rl w 




T1 1 


.4o 


T1 

J13 


AC 
.40 


rll^ 


7Q 


T1 /I 
114 


HA 

./4 


T1 A 

J14 


QO 

.oZ 


rllo 


Zl7 

.6/ 


T1 C 

115 


OO 

.38 


T1 C 


7n 
./O 


rllo 


.63 


T1 C 

116 


A 1 

.41 


T1 

J16 


7/1 

./6 


til/ 




T1 7 
11/ 


.6/ 


T1 7 

J17 


c^ 
.56 


rllo 


C>1 

.54 


T1 O 

Ho 




T1 Q 

J18 


.60 


T-T1Q 
tliy 


CI 
.31 


T1Q 

iiy 


OQ 

.3y 


T1 Q 


C7 

.5/ 


rlZU 


cn 
.5U 


Ton 
IZU 


QQ 


J2U 


.3o 


nzi 


C9 


T01 
IZl 


oz 
.36 


ni 


/17 
.4/ 




AC 


T99 
IZZ 


C7 

.5/ 


T99 


CA 






izo 


CI 
.51 




7ft 
./O 


1494. 


.OO 


19A 




T94 
JZ4 


.0 1 


149 ^ 


.DO 


T9C 
IZD 


HA 
./4 




.oy 


rizo 


7ft 
./O 


19A 
IZo 


0/1 

.34 


jzb 


.DO 


1-197 
nz/ 


cc 
.55 


197 
IZ/ 


7Q 

./y 


TO 7 


.Do 


T-J9Q 

rlZo 


7Q 

./o 


TOQ 
IZo 


>1 o 

.4Z 


TOQ 
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Test Norms 



students who answer all 60 of the U.S. History basic core items correctly could be assumed to 
be excellent U.S. History students. If everyone answered all of the items correctly, however 
a different mterpretation would have to be placed on the scores. At some point, scores must 
have a reference group grounded in the experience of all students. In some respect, at least, 
everythmgis good orbad by comparison. Norms tables provide that reference. Given anorms 
table, a student's score can be compared with other students' scores. 

Norms tables commonly have two points of reference: a scale of percentiles and a scale of 
standard scores. The former permits the location of a score within percentile ranks; thus a 
student is said to have exceeded the performance of 80% of the students in the norm group (in 
this case, U.S. History studen ts taking the North Carolina Test of U.S. History in May 1 988). The 
latter, standard scores, permits the location of a score within normally-distributed standard 
scores. This reference is appropriate if the student abilities are believed to be normally 
distributed. In a normal distribution, raw scores are given greater and greater weight as they 
diverge from the mean in either direction. 

The choiceof a metric for the standard score is arbitrary. To avoid inappropriate and confusing 
comparisons with some of the more common metrics, such as those employed in IQ scores or 
NCE scores, a metric having a mean of 50 and a standard deviation of 10 was chosen. Most 
curriculum research studies involving the summation of scores will find the standard score to 
be the statistic of choice. 

The norms table for student scores on the North Carolina Test of U.S. History is given in Table 
7. These scores set a baseline of comparison for present and future achievement in U.S. History. 
Thus, a student score in 1988, 1989, and future years can be referenced to the scores of all 1988 
U.S. History students in North Carolina. 

In summary, the utility of a test is its statistical equivalence of core tests from year to year, its 
broad sampling of the curriculum across time, and its initial norms table. 
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Table 7 

Norms for Student Scores on the North Carolina Test of U.S. History 


Row Score 


Percentile 


Standard Score° 


60 


99 


70.1 


59 


99 


69.1 


58 


99 


68.1 


57 


98 


671 


56 


97 


66.1 


55 


96 


65.1 


54 


94 


64.1 


53 


91 


63.1 


52 


89 


62.1 


51 


86 


61.1 


50 


83 


60.1 


49 


79 


59.1 


48 


76 


58.1 


47 


73 


57.1 


46 


69 


56.1 


45 


65 


55.1 


44 


62 


54.1 


43 


58 


53.1 


42 


54 


52.1 


41 


51 


51.1 


40 


47 


50.1 


oy 


44 


49.1 


3o 


40 


48.1 


J/ 


37 


47.1 


36 


34 


46.1 


35 


31 


45.1 


34 


28 


44.1 


33 


25 


43.1 


32 


23 


42.1 


31 


20 


41.1 


30 


18 


40.1 


29 


16 


39.1 


28 


14 


38.1 


27 


12 


37.1 


26 


10 


36.1 


25 


9 


35.1 


24 


7 


34.1 


23 


6 


33.1 


22 


5 


32.1 


21 


4 


31.1 


20 


3 


30.1 


19 


3 


29.1 


Less Than 19 


2 





^Adjusted to a mean of 50 and a standard deviation of 10.0. 
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Appendix A 

Test Content - Item Representation by Goal and Objective 



Goal/Obj Description 



% Teachers 

No. Items No. Items No. Items Reporting as 
1988 1989 1990 ^gasi/ 



Q 

(D 
<t) 

CO 
CO 



Goal 1 The learner will know important developments in 

American history from the pre Columbian period through 
the first years of exploration and discovery. 

1 .1 Locate major pre-Columbian cultures on an appropriate 
map of the Western Hemisphere. 

1 .2 Identify major artistic, scientific, agricultural, and 
mathematical contributions cf pre-Columbian cultures. 

1 .3 Describe reasons for European voyages of discovery in the 
15th and 16th centuries. 

1.4 Identify the areas of European political and economic 
influence in the Americas as of 1700. 

1 .5 Describe and explain differences between Native 
Americans and Europeans in attitudes toward land 
ownership. 

1 .6 Describe how geographic features both encouraged and 
discouraged European exploration. 

Goal 2 The learner will know that European nations differed in 
their methods of colonizing the Americas. 

2.1 Describe and distinguish among Spanish, French, and 
British methods of colonial control. 

2.2 Locate on an appropriate map areas controlled by the 
British, the Spanish, and the French in 1750. 



1 
0 
2 
1 
0 



1 

0 
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"Percentage of US History Teachers reporting the objective as basic to instruction in US History. 

40 



1 

3 
3 
1 
2 



3 
2 



1 
1 
2 
0 
1 



52.10 
29.68 
88.50 
73.23 
62.10 

65.38 



68.39 



79.55 



41 



Goal/Obj Description 



No. Items 
1988 



2.3 Analyze reasons for British, French, and Spanish conflicts 0 
in North America. 

2.4 Compare and contrast British, Spanish, and French 4 
colonies in terms of location and major economic activit^^ 

2.5 State ways in which geography either influenced, or did 0 
not influence, colonization. 

2.6 State causes and results of the French and Indian War. 0 

Goal 3 The learner will know important aspects of life in colonial 
America. 

3.1 Distinguish among New England, Middle, and Southern 2 
Colonies in terms of econonuc activities. 

3.2 Identify major colonial figures and evaluate their 0 
contributions to colonial life. 

3.3 Compare and contrast social life and recreational activity 2 
in New England, Middle, and Southern colonies. 

3.4 Distinguish between indentured servitude and slavery. 1 

3.5 Identify examples of British and French conflicts in North 0 
America during the colonial period. 

3.6 Identify the various national groups that came to America 1 
during the colonial period. 

3.7 Distinguish between the lifestyles of the various colonial 1 
groups. 

42 



^Percentage of US History Teachers reporting the objective as basic to instruction in US History. 



% Teachers 

No. Items No. Items Reporting as 



1989 1990 



Basic* 



'/0.42 
60.45 
62.38 
87.54 



3 2 88.46 

2 1 66.35 

1 2 31.63 

2 1 88.22 
2 1 65.48 

2 1 62.30 

1 1 33.01 
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Goal/Obj Description 



No. Items No. Items No. Items 
1988 1989 1990 



Goal 4 The learner will know cause and effect, major events, and 
major personalities of the Revolutionary War. 

4.1 Distinguish between immediate and long-term reasons for 
the American Revolution. 

4.2 Identify major events associated with the Revolutionary 
War. 

4.3 Identify and indicate the importance of major figures of 
the American Revolution. 

4.4 Identify factors which were the most : mportant in the 
defeat of the British in the Revolutionary War. 

4.5 Discuss the importance of the Declaration of 
Independence. 

Goal 5 The learner will know how the problems created by the 
Articles of Confederation led to the development of the 
Constitution. 

5.1 Identify the major problems of the government and 
economy under the Articles of Confederation. 

5.2 Understand the process of how the Constitution was 
written and ratified. 

Goal 6 The learner will know major trends, events, and problems 
of the "new nation." 

6.1 Identify states in the Union as of 1789, 1800, and 1815. 



0 
1 
4 
1 
0 



0 
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1 
1 

2 



1 
2 
2 
1 
1 



% Teachers 
Reporting as 
Basic* 



91.08 
87.86 
81.41 
82.32 
92.06 



88.92 
85.76 



40.51 
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Goal/Obj Description 



No. Items 
1988 



6.2 Describe relationships with Britain and France during 1 
1789-1815. 

6.3 Identify problenns facing the new nation, and describe 1 
how they were solved or left unsolved. 

6.4 Describe the effects of the War of 1812 in terms of our 1 
relationships with other people. 

6.5 Identify and describe important individuals and events 1 
that developed in the period from 1789-1815. 

Goal 7 The learner will know that the period of 1815-1850 was a 
time of both nationalism and sectionalism. 

3 

7.1 Understand the difference between sectionalism and 
nationalism. 0 

7.2 Identify states in the Union as of 1815 and 1850. 2 

7.3 Assess the importance of the westward movement in th? 
period 1815-1850. 0 

7.4 Describe phenomena that contributed to the growth of 
nationalism and/or sectionalism in the period 1815-1840. 5 

7.5 Identify and state the influence that individuals had on 
nationalism or sectionalism in the period 1815-1850. 1 

7.6 Compare and contrast political events or actions in terms 
of their influence on nationalism and/or sectionalism. 

46 
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% Teachers 

No. Items No. Items Reporting a? 

1989 1990 ^B,3^/ 

1 2 49.52 

2 1 80.97 

1 1 62.46 

2 1 58.01 

2 1 87.54 

2 1 41.75 

1 1 82.26 

2 1 62.13 
2 2 47.74 
2 2 55.48 
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Goal/Obj Description 



No. Items No. Items No. Items 
1988 1989 1990 
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1 

3 

0 

3 
1 

0 

2 
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Goal 8 The learner will know that sectionalism overcame 
nationalism and resulted in the Civil War. 

8.1 On a map of the United States, identify those states 
classified as slave states and free states in 1860. 

8.2 Identify events or crises leading to the secession of the 
Confederate States of America. 

8.3 Describe how international involvement contributed to 
the addition of new territories to the United States. 

8.4 Describe the phenomenon of Manifest Destiny. 

8.5 Describe the influence of slavery as an issue in the 
opening of the West. 

8.6 Understand the importance of selected personalities and 
events just before the Civil War. 

8.7 Understand economic factors that led to the Civil War. 

Goal 9 The learner will know that the Civil War and the 

Reconstruction of the Union affirmed the power of the 
national government. 

9.1 Understand how states divided along sectional lines. 

9.2 Understand the causes of the Civil War as inamediate and 
long-term. 

9.3 Recognize the significance of important political /miUtary 
events related to the Civil War. 

9.4 Distinguish similarities and differences between 2 
presidential and congressional plans for reconstructing the 
South. 

'Percentage of US History Teachers reporting the objective as basic to instruction in US History. 

48 



1 

2 
0 



2 

1 

2 

1 
2 

1 

1 



1 
2 

2 

2 



1 

2 

1 

2 
1 

1 

2 



I- 
1 

1 

1 



% Teachers 
Reporting as 
Basic* 



88.50 

96.15 

53.21 

78.27 
74.92 

67.63 

88.25 



80.71 
91.05 

65.59 

74.68 



49 



i 



Goal/Obj Description 



No. Items No. Items No. Items 
1988 1989 1990 



9.5 Describe the effects of Reconstruction on the South. 2 1 

Goal 10 The learner will know about major late 19th-century 
industrial and business developments. 

10.1 Identify the types of business organizations that 3 l 
developed after the Civil War. 

10.2 Identify the importance of technological advances made in 2 2 
the late nineteenth century. 

10.3 Understand the impact that industrialism and 1 i 
immigration had on American cities from 1820-1900. 

10.4 Identify major late nineteenth century industrial centers of 1 1 
the United States. 

10.5 Understand the importance of ^'le entrepreneur in the 2 2 
development of the American economy during the latter 

half of the nineteenth century. 

10.6 Understand major political developments between 1 1 
1865-1900. 

10.7 Understand major economic developments between 1 2 
1865-1900. 



2 
2 
1 
1 
1 

1 
2 



% Teachers 
Reporting as 
Basic* 



88.14 



57.69 
73.14 
74.19 
35.83 
46.43 

61.76 
65.80 
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Goal 11 The learner will know causes and events of the settlement 
of the West. 

11.1 Know the importance of railroads in the settlement of the 
West. 

11.2 Know conditions faced by farm families as they settled the 
West. 



1 
1 



'Percentage of US History Teachers reporting the objective as basic to instruction in US History. 



2 
1 



2 
1 



82.48 



57.69 
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Goal/Obj DesCTiption 



No. Items No. Items No. Items 
1988 1989 1990 



1 1 .3 Know the major reasons for various groups moving west. 

11.4 Know the impact that settlement in the West had upon 
native American Indians. 

11.5 Know the role of prominent women and men in the 
settlement of the West. 

11.6 Understand the role of the Cattle Kingdom in reality and 
myth. 

Goal 12 The learner will know that the late 19th-century was a 
time of great social, political, and economic change and 
uiu'est. 

12.1 Evaluate relationships between government and 
business in the late nineteenth century, identifying the 
laws or government policies which encouraged the 
development of large corporations. 

12.2 DesCTibe the important results of late nineteenth century 
immigration. 

12.3 Understand the causes, events, and effects of the agrarian 
revolt. 

12.4 Evaluate the importance of efforts of labor to organize into 
unions. 

12.5 Evaluate the influence of the Progressive Movement. 



3 
0 

1 

2 



0 



4 
1 
2 
2 



1 

2 

2 
2 



2 
2 
1 
2 



1 
1 

2 

2 



2 
1 
2 
2 



% Teachers 
Reporting as 
Basic" 



65.50 
a3.92 

42.90 

38.59 



59.68 



63/>/ 
49.35 
74.68 
71.15 
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Goal/Obj Description 



No. Items 
1988 
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Goal 13 The learner will know the major causes and events 

contributing to American foreign policy in the period 
1865-1920. 

13.1 Describe how imperialism influenced United States 4 
foreign policy at the turn of the century. 

13.2 Locate on a map general areas held in colonial control by 0 
the United States in 1910. 

13.3 Evaluate United States conduct as an imperial pov/er. 1 

13.4 State reasons why the United States proposed to remain 1 
neutral during World War I. 

13.5 Describe reasons why the United States entered World 3 
War I. 

13.6 Evaluate the effects of World War I on the United States 4 
and Europe. 

13.7 Assess the impact of the United States' retreat into 1 
isolation at the end of World War I. 

13.8 Understand the military role of the United Stares in World 2 
War I. 

Goal 14 The learner will know that the "time between wars" 

(1920-1940) was a time of isolation, disillusionment with 
international involvement, rapid change, and both 
economic prosperity and despair. 

54 14.1 State the extent to which different segments of America 2 
participated in the prosperity of the early 1920's. 
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% Teachers 

No. Items No. Items Reporting a; 
1989 1990 Basic* 



3 2 84.36 

3 2 63.06 

2 2 63.75 

2 2 89.94 

1 2 96.85 

1 2 87.15 

2 2 71.93 

1 3 68.90 

2 2 53.46 
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Goal/Obj Description 



No. Items No. Items No. Items 
1988 1989 1990 



14.2 Describe the isolation and disillusionment with 
international affairs thai the United States felt following 
World War I. 

14.3 Describe th* . factors contributing to the "Great 
Depression." 

14.4 Analyze the effects that movements and fads had on 
192(ys lifestyles. 

14.5 Identify important New Deal activities and government 
reform measures. 

14.6 Identify New Deal legislation that addressed problems in 
the social and economic communities. 

14.7 Evaluate the effects of New Deal legislation on efforts to 
organize workers. 

14.8 Evaluate the long-term influence of New Deal policies on 
the economic, social, and political institutions in the 
United States. 

Goal 15 The learner will know major causes, events, and results of 
World Warn. 

15.1 Know how World War I and its aftermath led to World 
War II. 

15.2 Describe reasons for Adolf Hitler's rise to political power. 

15.3 Know that ti\e 1930's was a period of expansion of 
totalitarian governments. 

15.4 Discuss the acts leading to the outbreak of World War II in 
Europe. 



5 
4 
5 
0 
2 
1 



1 
4 
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2 
2 
1 
2 
1 
2 



2 

2 



3 

2 
2 
3 
2 
2 



2 

3 



% Teachers 
Reporting as 
Basic* 



61.35 

94.03 
34.89 
88.25 
73.83 
51.58 
59.89 



94.06 

78.29 
76.39 

89.55 
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% Teachers 

No. Items No. Items No. Items Reporting as 



Goal/Obj Desaiption 1988 1989 1990 



Basic* 



1 1 2 59.18 

3 1 2 88.13 



15.5 Know those areas controlled by Germany, Italy, and Japan 
as of 1942. 

15.6 DesCTibe the steps which preceded the United States' entry 
into World War H. 

15.7 Describe the effects of World War II on social and 5 2 2 44.13 
economic groups in the United States. 

15.8 Describe selected military events from World War II, and 
discuss the military importance of each. 

15.9 DesCTibe postwar Europe and the orgaiuzations 
established to maintain peace. 

Goal 16 The learner will know the major events, and their causes, 
and effects of the foreign policy of the United States since 
1945. 



1 2 54.17 

1 3 75.70 



1 2 74.44 

1 2 74.81 



16.1 Describe the expansion of communism/ socialism from 
1945-1960. 

16.2 Identify the major world events from the "cold war" era 
and evaluate their impact on the United States. 

16.3 Identify and explain the importance of the major political 
figures and events of the Korean War era. 

16.4 Evaluate the foreign policy dilemmas faced by the United 
States in its thirst for oil. 

16.5 Know the importance of the military /political alliaicces in 0 2 2 61.51 

5 8 the cold war period. 

16.6 Identify the major figures of the Cold War era and assess 
their impact on this period. 



2 2 2 63.16 

1 1 2 37.17 



2 3 56.25 



Goal /Obi 


OpsfTintinn 


No. Items 
1988 


No. Items 
1989 


No. Items 
1990 


% Teachers 
Reporting as 
Basic* 


16.7 


Know the important persons and events during the 


3 


2 


2 


46.88 




"McCarthy Era." 










16.8 


Identify and discuss the major causes, effects, political 


2 


2 


2 


76.37 




figures, and events of the Vietnam War effort. 










16.9 


Assess the effects of the Vietnam War on American 


6 


2 


4 


66.73 




society. 










Goal 17 


The learner will know that the years since 1945 have been 












a time of great social, economic, and political change. 










17.1 


Analyze the course of the American economy since World 


0 


2 


3 


28.04 




War n, with emphasis on cyclical periods of growth and 












decline, and the reasons for these economic up-swings and 












down-turns. 










17.2 


Describe the social changes occurring in the United States 


5 


2 


2 


47.39 




beginning with World War II. 










17.3 


Evaluate a list of the major political changes and events 


2 


2 


2 


53.47 




from 1950-1980. 










17.4 


Identify and evaluate major civil rights events and 


2 


1 


2 


72.90 




movements from the past 30 years. 










Goal 18 


The learner will know that the post World War II years 












have been a period of great technological change. 










18.1 


Identify and assess the importance of the techno'.ogical 


5 


2 


5 


50.47 



changes occurring in the post World War II years. 
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Appendix B 

Goals and Objectives Added to the US History Curriculum in 1989 



Goal/Obj Description 



4.6 Identify the niajor ideas about government expressed in the Declaration of 
Independence. 

4.7 Know the major grievances toward the King of England enumerated in the 
Declaration of Independence. 



5.3 Know the major arguements expressed in the writings known as the 
Federalists and Anti-Federalists papers. 

5.4 Understand the rights of the indivdiual outlined in the first ten 
amendments of the United States Constitution. 

5.5 Know the major powers, duties, and limitations of the President, Congress, 
and the Federal Judiciary systems. 



3 7.7 Know that issues in the debate over nullification were similar to those 

raised in the debate over how much power the federal government should 
have at the time when the United States Constitution was written and 
ratified. 



9.6 Know the impact of the 13th, 14th, and 15th Amendments to the United 
States Constitution. 

9.7 Understand the relationship between the struggle over plans for 
reconstruction and the principles of checks and balances and separation of 
powers found in the United States Constitution. 



17.5 Evaluate the impact of recent Constitutional Amendments, rulings, and 
federal legislation on United States citizens. 

Goal 19 The learner will know the influence of mapr religious faiths on the culture 
and history of the United States. 

19.1 Understand the development of religious liberty and toleration. 

19.2 Understand the role of religion in social change. 

19.3 Understand the growth of religious pluralism. 

19.4 Understand the role of religion in contemporary social, political, and 
economic events. 
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